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Claims 

1 . A method for generating a wide image video sequence, said method comprising the 
steps of : 

a. generating a set of calibration parameters related to a device having at least two video 
5 cameras which are arranged in a predetermined relationship to each other, said parameters 

being unique for the at least two cameras and their current location as related to the object 
being recorded; 

b. recording synchronously video sequences using each of said at least two video cameras, 
and 

10 c. generating a wide image video sequence from each of said synchronously recorded 
video sequences. 

2. A method according to claim 1 in which the synchronously recorded video sequences 
are stored in a memory means. 

15 

3 . A method according to claim 1 in which the synchronously recorded video sequences 
are used concurrently for generating the wide image video sequence. 

4. A method according to claim 3 in which the wide image video sequence is transmitted 
20 live. 

5. A method according to claim 3 in which the wide image video sequence is stored on a 
memory means. 

25 6. A method according to claim 1 in which the generation of calibration parameters comprises 
the following steps: 

a. Start of calibration process; 

b. Synchronize the sequences from each camera, which means that at least a video 
sequence has to be recorded by all cameras; 

30 c. Compute inter-image projective transformations; 

d. Use the transformations to refer each image to a common reference frame; 

e. Choose a real or virtual reference camera such that certain lines on the pitch and/or 
stadium are essentially horizontal and parallel in the wide image; 
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f. Select a rectangular region of interest within the wide image. This region contains 
e.g. the entire pitch and as much of the stadium as is required or visible; and 

g. Record all computed values resulting from the calibration process to be used as the 
calibration parameters. 

7. A method according to claim 6 in which the steps of finding the lens distortion 
parameter(s) for each camera, and correcting radial distortion in each image produced 
are comprised. 

8. A method according to claim 6 in which the step of selecting non-linear distortion 
parameters to reduce perspective distortion of the wide image is comprised. 

9. Method according to claim 1 in which step b is performed manually by identification of 
corresponding features in concurrent video images and the coordinates for these 
corespondning features are input to a computer means. 

1 0. Method according to claim 1 in which step b is performed automatically by an 
algorithm for identification of corresponding features in concurrent video images and 
the coordinates for these corresponding features are input to a computer means. 

1 1 . Method according to claim 1 which comprises the following steps: 

a. Apply the computed and registered calibration parameters. 

For each pixel in the wide image, compute and store parameters describing 

1 . Which pixels from which image(s) contributes to this pixel in the wide image. 

2. How much these pixels each contribute to the wide image; 

b. Repeat until the end of the sequence is reached; 

c. Obtain one new image from each camera; 

d. If required, update the parameters needed to transform intensities 
(colours/brightness) in one or more cameras to eliminate visible seams; 

e. If necessary, adjust the intensities (colours/brightness) in the images from one or 
more cameras; 

f. Create the current seamless, wide image from the current images from each 
camera; 

g. Output the wide image to a display or to a memory means; and 

h. End of sequence. Return to step b until end of generation of the wide image video 
sequence. 

12. Method according to claim 1 1 wherein the new images from each camera are read 
from live sources, each such source comprising a video camera. 
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13. Method according to claim 1 1 wherein the new images from each video camera are 
read from a memory means. 

5 14. In a device having a processor means, which executes instructions stored in at least one 
memory means, a method for generating video sequences comprising the steps of: 

a. generating a set of calibration parameters related to a device having at least two video 
cameras which are arranged in a predetermined relationship to each other, said parameters 
being unique for the at least two cameras and their current location as related to the object 

10 being recorded; 

b. recording synchronously video sequences using each of said at least two video cameras, 
and 

c. generating a wide image video sequence by generating from each of said synchronously 
recorded video sequences. 

15 

15. In a device according to claim 14, the method in which the synchronously recorded video 
sequences are stored in a memory means. 

16. In a device according to claim 14, the method in which the synchronously recorded 
20 video sequences are used concurrently for generating the wide image video sequence. 

17. In a device according to claim 14, the method in which the generation of calibration 
parameters comprises the following steps: 

a. Start of calibration process; 
25 b. Synchronize the sequences from each camera, which means that at least a video 

sequence has to be recorded by all cameras; 

c. Compute inter-image projective transformations; 

d. Use the transformations to refer each image to a common reference frame; 

e. Choose a real or virtual reference view such that certain lines on the pitch and/or 
30 stadium are essentially horizontal and parallel in the wide image; 

f. Select a rectangular region of interest within the wide image. This region contains 
the entire pitch and as much of the stadium as is required or visible; and 

g. Record all computed values resulting from the calibration process to be used as the 
calibration parameters. 
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18 In a device according to claim 14, the method in which the generation of calibration 
parameters the following steps of finding the lens distortion parameter(s) for each 
camera, and correcting radial distortion in each image produced are comprised. 

5 

19 In a device according to claim 14, the method in which the generation of calibration 

parameters the following step of selecting non-linear distortion parameters to reduce 
perspective distortion of the wide image is comprised. 

10 20. In a device according to claim 14, the method in which step b is performed manually by 
identification of corresponding features in concurrent video images and the coordinates 
for these corresponding features are input to a computer means. 

21 . In a device according to claim 14, the method in which step b is performed 

1 5 automatically by an algorithm for identification of corresponding features in concurrent 

video images and the coordinates for these corresponding features are input to a 
computer means. 

22. In a device according to claim 9, the method which comprises the following steps: 
20 a. Apply the computed and registered calibration parameters. 

For each pixel in the wide image, compute and store parameters describing 

1 . Which pixels from which image(s) contributes to this pixel in the wide image. 

2. How much these pixels each contribute to the wide image; 
b. Repeat until the end of the sequence is reached; 

25 c. Obtain one new image from each camera; 

d. If required, update the parameters needed to transform intensities 
(colours/brightness) in one or more cameras to eliminate visible seams; 

e. If necessary, adjust the intensities (colours/brightness) in the images from one or 
more cameras; 

30 f. Create the current seamless, wide image from the current images from each 

camera; 

g. Output the wide image to a display or to a memory means; and 

h. End of sequence. Return to step b until end of generation of the wide image video 
sequence. 
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23. In a device according to claim 22, the method wherein the new images from each 
camera are read from live sources, each such source comprising a video camera. 

5 24. In a device according to claim 22, the method wherein the new images from each video 
camera are read from a memory means. 

25. A computer readable memory means storing a program which executes the steps of: 

a. generating a set of calibration parameters related to a device having at least two video 
10 cameras which are arranged in a predetermined relationship to each other, said parameters 

being unique for the at least two cameras and their current location as related to the object 
being recorded; 

b. recording synchronously video sequences using each of said at least two video cameras, 
and 

15 c. generating a wide image video sequence by generating from each of said synchronously 
recorded video sequences. 

26. A memory means storing a program according to claim 1 7, in which the synchronously 
recorded video sequences are stored in a memory means. 

20 

27. A memory means storing a program according to claim 17, in which the synchronously 
recorded video sequences are used concurrently for generating the wide image video 
sequence. 

25 28. A memory means storing a program according to claim 17, in which the generation of 
calibration parameters comprises the following steps: 

a. Start of calibration process; 

b. Synchronize the sequences from each camera, which means that at least a video 
sequence has to be recorded by all cameras; 

30 c. Compute inter-image projective transformations; 

d. Use the transformations to refer each image to a common reference frame; 

e. Choose a real or virtual reference view such that certain lines on the pitch and/or 
stadium are essentially horizontal and parallel in the wide image; 
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f. Select a rectangular region of interest within the wide image. This region contains 
the entire pitch and as much of the stadium as is required or visible; and 

g. Record all computed values resulting from the calibration process to be used as the 
calibration parameters. 

29. A memory means storing a program according to claim 28, in which the steps of 
finding the lens distortion parameter(s) for each camera, and correcting radial 
distortion in each image produced are comprised. 

30. A memory means storing a program according to claim 28, the step of selecting non- 
linear distortion parameters to reduce perspective distortion of the wide image is 
comprised. 

31. A memory means storing a program according to claim 28, in which step b is 

1 5 performed manually by identification of corresponding features in concurrent video 

images and the coordinates for these corresponding features are input to a computer 
means. 

32. A memory means storing a program according to claim 28, in which step b is 

20 performed automatically by and algorithm for identification of corresponding features in 

concurrent video images and the coordinates for these corresponding features are input 
to a computer means. 

33. A memory means storing a program according to claim 28, which comprises the 
25 following steps: 

a. Apply the computed and registered calibration parameters. 

For each pixel in the wide image, compute and store parameters describing 

1. Which pixels from which image(s) contributes to this pixel in the wide image. 

2. How much these pixels each contribute to the wide image; 
30 b. Repeat until the end of the sequence is reached; 

c. Obtain one new image from each camera; 

d. If required, update the parameters needed to transform intensities 
(colours/brightness) in one or more cameras to eliminate visible seams; 
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e. If necessary, adjust the intensities (colours/brightness) in the images from one or 
more cameras; 

f. Create the current seamless, wide image from the current images from each 
camera; 

g. Output the wide image to a display or to a memory means; and 

h. End of sequence. Return to step b until end of generation of the wide image video 
sequence. 

34. A memory means according to claim 28, wherein the new images from each camera 
are read from live sources, each such source comprising a video camera. 

35. A memory means storing a program according to claim 28, wherein the new images 
from each video camera are read from a memory means, 

36. A video recording apparatus comprising: 

a microprocessor(130), a memory means (120) for storing program for generating a set of 
calibration parameters related to a device having at least two video cameras which are 
arranged in a predetermined relationship to each other, said parameters being unique for 
the at least two cameras and their current location as related to the object being 
recorded; 

said memory means (120) also storing program for recording of wide image video sequences; 
read and write memory means (140) for storing data relating to recorded video sequences 

from at least two video cameras; 
input means (300) for input of manual input of parameters, input of recorded video sequences, 

and output means (300) for output of a wide image video sequence. 



